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Abstract 



v^ ■ In this paper we consider the problem of how to computationally test whether a 

^sj ' matrix inequality is positive semidefinite on a semialgebraic set. We propose a family 

of sufficient conditions using the theory of matrix Positivstellensatz refutations. When 
the semialgebraic set is a hypercube, we give bounds on the degree of the required 
V,^ ' certificate polynomials. 

q' 

^ ' 1 Introduction 

-4— > 

In this paper we consider the following problem. 

Problem 1. Suppose Hq, . . . , H„i € M"^" are symmetric matrices, and A C M™. Define 
the affine map G : R" ^ R"^" by 
> 

in 

^—v ' for all 5 G K™. We would like to know if 

\n '. 

^ . G{S) > for all S e A. 

^~—i , This problem is a robust semidefinite program, and it has many important applications 

C^ ' in control and optimization. One motivating application is testing quadratic stability, as 

follows. Consider the parameterized family of linear time-invariant systems 



i=l 

Here S g M™ is a vector of uncertain parameters. We would like to check whether the 
above system is stable for all (5 G A. This problem has been addressed in |18l I25L 171] . 
A well-known approach is to seek a quadratic Lyapunov function which proves stability 
for all parameters within the uncertainty set A. That is, we would like to find a positive 
definite matrix P G K"""" such that 



i=l 4=1 
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for all (5 e A. Testing whether P satisfies this inequality is equivalent to Problem Q] via 
the identification Hi = —AfP — PAi for t = 0, . . . , m. 

More generally, we can convert a more general class of robust optimization problems 
to the form of Problem ^ We would like to solve 



T 

mm c X 



subject to ^0 + yj XiAi > for all (^o, ■ ■ ■ i Ai) G ^ 
where the set of matrix tuples U is given by 

m 

U = {{A,,...,A^)^ {Al ...,Al) + Y^ <5,(4, ...,At)\seA] 

k=l 

To find the optimal solution to this robust semidefinite problem, we need to be able to 
efficiently verify that a given x satisfies the constraints, and this is equivalent to Problem^ 
In fact, even this verification problem is hard for most uncertainty sets. 

Problem^has been addressed in the literature. When the uncertainty set is an ellipsoid, 
the problem may be converted to a binary optimization problem P] . When the uncertainty 
set is a hypercube. Problem ^ is called the matrix cube problem, and it was shown to be 
NP hard in |15| . In the case when the uncertainty set is a bounded polytope, it is sufficient 
to check the matrix inequality at the vertices. Notice that in the case when A is a cube 
there are 2™ vertices, and so this approach scales very poorly as m grows. Similar results 
for the quadratic stability problem are shown in [2], [HI- 

To reduce computational complexity , several sufficient conditions have been proposed, 
such as the use of the 5-procedure to construct a set of scalar certificates |H]. Ben-Tal 
and Nemirovski also proposed a stronger condition which does not exhibit the above poor 
scaling ^. In this paper we will generalize this condition, so we state it here. Here S" 
denotes the set of real n x n symmetric matrices. 

Theorem 2. Suppose A is the cube 

A= {(5eM'" I \Si\ < 1 for alii} 
Define the set Xt C §" x • • • x S", where (Xi, . . . , X„-i) G Xt if o-nd only if 



i^o-^^. >0, 



Xi + Hi > 0, for all i ~ 1, . . . ,m 

Xi ^ Hi > 0, for all i ~ 1, . . . ,m. 

Then G{S) is positive semidefinite for all 5 & IS. if Xt is not empty. 

This condition may be tested via semidefinite programming. The paper ^ also shows 
that if the above SDP condition is infeasible then there exists a 5 within a larger cube 
such that G{5) is not positive semidefinite. This gives an estimate of the conservatism of 
this test. 

The matrix cube problem (and also therefore Problem QJ is closely related to binary 
quadratic programming. Here, we would like to find 

min X Ax 
subject to X G {-1, 1}" 
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Without loss of generality we may assume A is positive definite, and it is then straight- 
forward to see that the problem is equivalent to the following matrix cube problem. 



subject to 



t 

> for aU X £ {-1, 1}" 



t x^ 



X 



A- 



In general such quadratic programs are hard, and much research has been done to 
address this, for example using the Lagrangian relaxation to compute a lower bound on 
the optimal value |23| , or using semidefinite programming via a lifting approach |14| . The 
gap between the relaxed problem and the actual problem may be reduced by introducing 
additional variables and redundant constraints ^. Lasserre used an approach based on 
moments and showed that one needs at most 2™ — 1 additional variables ^1 El for 
an exact solution. This approach is also related to the dual of the refutation approach 
adopted in this paper. 

In this paper, instead of searching a set of scalar certificates using the 5-procedure, we 
will construct a sufficient condition via a search for a polynomial certificates. If such a 
certificate exists, then there is no i5 G A such that the afSne function G is not positive 
semidefinite. Our approach is applicable to general semi-algebraic uncertainty sets, in- 
cluding ellipsoids and hypercubes. In this formulation, we construct a family of refutation 
sets which have a hierarchical structure. If the current refutation set does not yield a 
feasible certificate, we may seek for higher degree certificates. Similar approaches have 
been used to analyze and synthesize output feedback controllers for LPV systems P^ . 

For some uncertainty sets we will also show that if there is no 5 e A for which G is 
not positive semidefinite, then there will exists a certificate of specific degree. When the 
uncertainty set is a hypercube, we show that the highest degree needed is at most 277i. 
We also study the case when the certificates are restricted to be quadratic and we show 
the resulting condition is tighter than the best existing result of Theorem|5| In addition, 
we give several cases when our conditions using quadratic certificates are necessary and 
sufficient. Finally, we give some numerical examples to compare our results with others. 

2 Preliminaries 

We use the following standard notation. The matrix /„ is the n x n identity. For X G S", 
the notation X > means that X is positive definite. The vector Ci € R" has the ith 
entry equal to 1 and all other entries equal to zero. The vector 1 e M" has all entries 
equal to 1. 

The set R[a::i , . . . , a;„] is the ring of polynomials in n variables with real coefficients. We 
often abbreviate R[a;i, . . . , Xn] to simply R[a;]. Every polynomial / G R[a:] can be written 
as 

/ = ^ c„x" 

where W C N", and the notation x" is defined by 

™" _ a^ OLi «„ 

X — X]^ 0-2 ■ ■ ■ ■'^n 

A polynomial g e R[a;] is called a sum of squares (SOS) if it can be expressed as 



g{x) = Y.f^('^y 
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for some polynomials fi G R[x]. Wc use ^[x] to represent the set of sum-of-squares 
polynomials in R[a;], and abbreviate it to S when the dimension is clear from the context. 
We also extend this definition matrix polynomials as follows.. Let ]R[x]'"^" denote the 
set of TO X n polynomial matrices and §[a;]" denote the set of n x n symmetric polynomial 
matrices. We define the notion of sum-of-squares for matrix polynomials as follows 

Definition 3. A matrix polynomial S G §[a;]™ is called a sum-of-squares if there exist a 
matrix polynomial T £ R[a;]"'^* such that 

S{x)=T{x)T{xf. 

This is a generalization of SOS representation used for scalars. We will use Y,[x]" to 
represent the set oi n x n SOS polynomial matrices. We also define two specific sets Qi, 
Q2 which will be useful in later sections. 

Definition 4. Let Wi = {a e N™ | a, < 2 for all i = 1,...,to} and W2 ^ {a € 
^"^ I Si=i Q^i ^ 2}. The sets Qi, Q2 are defined as 



Qi = [Y^ Ca(5" I Ca G S" for all a e M^i} 

aeWi 

Q2 = [Y^ CJ"" I Ca e S" for all a G Wsj 



aeW2 

Note that polynomials in Qi have degree less than or equal to 2m and polynomials in 
Q2 have degree less than or equal to 2. 

When F G S[a;]", it is clear that F is positive semidefinite for all x G M". One may 
address positive semidefiniteness of a matrix polynomial over a restricted domain using 
the following lemma, which gives a sufficient condition. 

Lemma 5. Suppose /i, . . . , /„ G M[x] and Q G R[a;]™ is a symmetric matrix polynomial. 
Define the set 

P = I x G M" I f^{x) > /or a/n = 1, . . . , to I 

Then, Q{x) > for all x ^ D if there exist SOS polynomial matrices So, Si, . . . , Sn G 
I][x]" such that 

n 

Q{x) = So{x)+Y,S^{x)f^{x) 

8=1 

It is also known that if T> is compact, and with additional technical restrictions, then 
the above condition is also necessary |221 ; this is an extension of a well-known result by 
Putinar ^. 

3 Positivstellensatz refutations 

In this section, we will study Problem ^ when the set A is semialgebraic, that is 

A = |5 G K" I f^{6) > 0, for i = 1, . . . ,to| 

where fi, . . . , fm G R[(5]. It is clear that a cube and an ellipsoid can be expressed as semi- 
algebraic sets. The following condition provides a simple condition under which G{5) is 
positive semidefinite for all 5 G A. 
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Theorem 6. The matrix polynomial G{5) is positive semidefinite for all d Cz A if there 
exist SOS polynomial matrices So, Si, ... , Sm satisfying 

G{6)=So + Y,S^f^{S) (1) 

i=l 

This is a simple consequence of Lemma and we may view it as provided a certificate 
refuting the existence of 5 € A such that G{5) is not within the positive semidefinite 
cone. The certificate is the sequence of polynomials So, . . . , Sm- As discussed in the 
previous section, this condition is also necessary if additional technical conditions on A 
are satisfied [22 (both polytopes and ellipsoids satisfy these conditions.) 

One thing we have not yet specified is the degree of the certificates required. Al- 
though we may pursue high degree certificates, the computational complexity of finding 
5*0, ... , Sm grows rapidly as we search over sets containing high-degree polynomials. In 
many applications of this refutation approach, a bound on the degree of the required 
certificates is not known. However, in some cases, we can show a degree bound. First, 
we consider the case when the uncertainty set A is a simplex. 

Theorem 7. Suppose A is the .simplex 

A = {5 e M™ I J > 0, 1^(5 < 1} 

Then G{S) > for all S Cz A if and only if there exist positive semidefinite matrices 
So, ■ . . , Sm+i G §" such that 

m 

G{S) ^So + Y. SA + (1 - l^S)Sm+i (2) 

1=1 

Proof. Sufficiency is straightforward as in Theorem |^ and we will now prove necessity. 
Assume that G{S) > for aU S € A, then 

Ho>0 
Ho + H.i>0 for i = 1, . . . , m 

It can be verified that So = 0, Si = Ho + Hi ior i = 1, . . . ,m and Sm+i = Ho satisfy ^ 
and they are positive semidefinite. ■ 

The above theorem precisely specifies the certificates in the very special case that the 
the uncertainty set is the simplex. If the uncertainty set is expressed as a convex hull of 
the vertices, one can also convert the verification problem to the above form and apply 
the same refutation. 

Although the theorem gives necessary and sufficient conditions, the number of required 
certificates is the same as the number of vertices. For the hypercube which has 2™ 
vertices, this soon becomes intractable as m grows. On the other hand, the hypercube 
has another representation as a semialgebraic set 

A = {SeM."'\S^ <l,ioii = l,...,m} 

and in the following result we use this representation. 

Theorem 8. Define the set Xi C S[(5]" x§[(5]" x • • • xS[(5]" such that {So, Si,..., Sm) e Xi 
if and only if 

ni 

G{S) = So + Y.il-5^)S.. (3) 

i=l 

Then, G{6) > for all 6 within the unit cube if and only if Xi is not empty. 
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Proof. If there exist {So, ■ ■ ■ , Sm) satisfying Q, then it is clear that the right hand side 
of JSJ is positive semidefinite for ah 6 at the vertices of the cube, and this imphes that 
G{d) > for all S € A. 

Now, we show the converse. The set of vertices may also be represented as the set of 5 
satisfying 1 — Sf > and (5,^ — 1 > for i = 1, . . . , tti. By choosing r = \/rn, we can verify 
that 



1<511 



2^2(1 -S^) + Y^iS^^l). 



i=l 



i=l 



Since G{S) > for all 6 at the vertices, there exist SOS matrix polynomials Po,Pi, . . . , P^, 
Pm+i, • ■ • , P2m such that 



G{5) ^ Po + E(l - ^')P^ + E('^' - 1)^' 



in+i 



1=1 



from Theorem 2 in |22 | . Letting 5*0 — Pq and Si — Pi — Pm+i for i — 1, . . . ,m completes 
the proof. 



The above theorem shows that Si, ... , Sm only need to be symmetric matrix polyno- 
mials instead of SOS matrix polynomials. Now. we show the refutation is degree bounded 
and the highest degree of certificates required is 2m. 

Theorem 9. Define the set X2 C Xi such that [Sq, . . . ,Sm) G X2 if and only if 
{So,...,Sm) G Xi and Si, . . . , Sm G Qi. Then, G{S) > for all 6 within the unit 
cube if and only if X2 is non-empty. 

Before proving the theorem, we show two lemmas. 

Lemma 10. Suppose there are two symmetric matrices A,B e §" satisfying —A < B 
and B < A. Then 



A B 
B A 



>0. 



Proof. Suppose -A < B and B < A. Then 

\A-B 



A B 
B A 



I I 
-I I 



A + B 



I I 
-I I 



>0. 



Lemma 11. Suppose Hq, . . . , Hm G §"• Define the block diagonal matrices 



Gk^ 



Hk 



G§^ 



for k ~ 1, . . . ,m. 



and recursively define the sequence Nq, Ni, . . . , Nm by 



Nk 



'Nk-i Gk 
Gk Nk-i 



No^Ho 



Then Nm > if 



ho+Yj ^^^' - 0' -^"^ ^^'' ^ ^ •f "1' '^y 



(4) 
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Proof. We prove this by induction on m. First notice that the result is triviaUy true 
when m ~ 0. To show the case when m = k + 1, we have 

fc+i 
Ho + Y^ S,H, > for aU 5i,..., 4+i e {-1, 1} 

if and only if 

k k 

{Ho + Hk+i) + Y^ 5,H, > 0, {Ho- Hk+i ) + ^ S,H, > 

j=l 4 = 1 

holds whenever Si, . . . ,Sk G { — 1,1}. Now assume the lemma holds for m = k, and this 
then implies 



Nk-i Gk 
Gk Nk-i 



+ Gfc+i > 0, 



A^fe-i Gk 
Gk Nk-i 



- Gk+i > 0. 



Applying Lemma [TUI proves the theorem. ■ 

Now, we prove Theorem |3 

Proof of Theorem (S) Sufficiency is implied by Theorem and we will now prove 
necessity. Suppose G{S) > for all S within the unit cube. It is shown in Lemma 1111 
that Nfn > 0. Let zq = 1 and define a sequence of vectors of monomials zq, zi, . . . , Zm 
recursively as follows 



SiZi^i 



for z = 1, 



. , m. 



Choose S'o as 



So^2-"'{zm(^lfN^{z^(^I). 



It is clear that S'o G Y.[x, 6]n Qi. 

As for Si, ... , Sm, we let I? = {1, ... , m\ and define the sets £k,i,J^j,k,i as follows, 

ffc ; = IaciV \ \A\ ^ I and k<^A\, 

Tj^k.i - { ^ C P I |A| = /, and .7, fc ^ A }. 

We also define the polynomials 






Let Si, ... , Sm as follows 



Cm-l N 

Cl + 2J (^i+lPk.i 



where c e M" and d e R"-i satisfy 
M{m)c = ei - 2^™1, 






i^k ^ 



for fc = 1 , . . . , 771 



M{m - l)d = ei - 2" 
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and M 



are 



M{m) = 



-1 

















771 — 1 










— TTl - 


hi 




1 



The highest degree of ^i , . . . , Sm in each 6i is at most 2 which imphes that Si ... , Sm S 
Qi. Expanding So + X]i=i(l ~ ^i)Si shows that 5*0, ... , Sm satisfy ^. m 

The reason that degree bounded So, Si., ... , Sm exist is because of the persymmetric 
structure of Nm. . We now have a family of refutations for the matrix cube problem. If 
G{6) > for all S E A, then we have shown that there will exist a certificate of degree at 
most 2m. 

This condition may also be directly expressed as a semidefinite program. Although 
the degree bound on the certificates grows linearly with m, the number of monomials 
required to express the certificates (i.e., the dimension of Qi) grows exponentially in m. 
Of course, since we have exactly solved the problem this is expected; the original problem 
is NP-hard. 

When the cube is high-dimensional, the computational complexity of searching X2 
is also high. To reduce computational effort, we may limit the search to low degree 
certificates. We now consider this case, limiting the search to the set ^"3 as follows. 

Definition 12. Define the set X^ C X2 such that (Sq, . . . , Sm) G '%3 if o-nd only if 
{So, ..., Sm) e X2 and So € Q2, 5*1, . . . , 5™ € S". 

Testing if A3 is nonempty is equivalent to the following semidefinite program. 

find Xi,..., Xm e §", L e s"("'+^) 





^00 




Lorn 


such that L = 














^7nm_ 


rn 






o = >>„- 


Ho 




i=0 






= 1 


a ^i 







>0 



(5) 



— Loi + Loi ^ Hi 



for 1 = 1, 
for 1 = 1, 



, m 



= L,, 



L 



Hj -r ^,j ioi i,i = l,...,m,i^ j 

If the above semidefinite program is feasible, we may choose Si = Xi for i = 1, . . . ,m 
respectively. This implies that Si, ... , Sm are positive semidefinite. 

The gap between verifying the matrix cube problem and checking the non-emptiness 
of Xz can be interpreted as the degree difference between certificates in X2 and A3. The 
degree of certificates in X^ is at most 2, instead of growing linearly with respect to m. 
Although this means that the condition is conservative, we now show that it is still tighter 
than the previously well-known condition in Theorem 13 

Theorem 13. If Xt is not empty, then X^ is not empty. 

Proof. Suppose {Xi, . . . ,Xm) G Xt. It is clear that Xi is positive definite for i = 
1, . . . ,m. From Lemma 11(11 Xi, . . . , Xm also satisfy 

Xi Hi 

Hi Xi 



>0, 



for i = 1, 
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which by the Schur complement imphes 

X,>H,Xr^H„ ioYi = l,...,m. 
Thus, 



^ m ^ m m 



>0. 



Applying the Schur complement again gives 



Tj 1 Y^"i Y 

^a - 2 2^1=1^' 



2^1 



-^H„ 



^Hr, 



2^-" 



>0 



(6) 



Let 



Sq — 



I 



I 

(5(8)/ 



Si = -Xi, for i = 1, . . . ,TO. 



It is clear that 5*1, ... , Sm arc positive semidefinite. Also Sq G S n Q2- Expanding 5*0 
shows (^o, . . . , Sjn) e X3. m 

The above theorem shows that every certificate in Xt has a corresponding instance 
in X3. We show that our condition is strictly tighter than the previous condition via a 
counterexample in Section 15.11 Comparing the two semidefinite programs, we recognize 
that jnj imposes constraints on the off-diagonal entries such that Lij = for i,j = 
1, . . . , TO, z =/= j. The entries are relaxed to be skew symmetric in ^ and this condition 
is still sufficient. This skew symmetric structure arises naturally in the Positivstellensatz 
refutation. 

To see the relationship of the conditions so far, we show the relationship among the 
refutation sets in Figure ^ The set Xi and X2 are the two largest refutation sets and the 
computational complexity of searching these sets grows exponentially with respect to the 
dimension of the uncertainty. If we limit the search for refutations to the set X3, then 
computational complexity is reduced and the results are still tighter than the existing 
conditions Xt- 



4 Tightness of quadratic certificates 

In the previous section, we showed that the search for Positivstellensatz refutations for 
the matrix cube problem may be limited to polynomials of low degree with no additional 
conservatism. We also provided a hierarchical structure of refutation sets. Although using 
quadratic certificates for the refutation is only sufficient, it is computationally tractable 
and the conditions are tighter than those of prior work. In this section, we show that 
searching quadratic certificates is also necessary in certain cases. First, we study the case 
when the number of uncertainty parameters m is less than or equal to 2. 



Theorem 14. Suppose m < 2. 
if there exists {Sq, Si, S2) G X3. 



Then G{S) > /o?' all S within the unit cube if and only 
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MC problem 



<^ 



Xi^ 



Positivstellensatz 
refutations 



X2^ 



^-3^ 



....:::^.-:... 



Xt^ 



Figure 1: Set hierarchy 

Proof. Sufhciency is proved in the previous section and we need only prove necessity. 
Suppose G{5) > for all 5 within the unit cube, then 



iJo Hi H2 

Hi Hq H2 

H2 Hq Hi 

H2 Hi Hq 



>0. 



from Lemma 1111 Without loss of generality, assume Hq is nonsingular. Applying the 
Schur complement gives 



Hi 


H2 







\ Hq 





- 


Qi 


2 


Hi 




Qi' 





Q2 
Q3 



>o, 






Hi 


H^ 




\ 








+ 


'2 

















1 





Q3 


Ql 





Q2 


QiJ 



>0 



where 



Summing the above two inequalities gives 

2x70 2iji 2_ri2 
2Hi Hq 
2H2 i/o 



"Ql Q2 
Ql Q3. 


= 


'H2 
Hi. 


Ho' 


'H2 



-\T 





Q3-Q1 QI-Q2 
Q2-QI Q1-Q3 



>0 



Let Wi ^ liHo + Q3 - Ql), W2 ^ \{Ho - Q3 + Ql)- Define J as follows 



J = 



iJo - M^i - 
-Hi 

Ih, 



Wo 



2 
1 

and the above inequality implies J > 0. Let 

T 



Wi 

\{Q2^Ql) 



\{Ql 



W2 



So — 



I 

6(»I 



J 



I 

(5(g)/ 



Si = Wi, 



S.^Wo 



Expanding Sq shows (5o, 5*1, S'2) G A3 



When TO > 2, if Hi, . . . ,Hra are either positive or negative semidcfinite, quadratic 
certificates again provide a necessary condition. 



10 
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Theorem 15. Suppose the matrices Hi, . . . , Hm are either all positive semidefinite or 
all negative semidefinite, then G{S) > for all 6 within the unit cube if and only if there 
exist {So,Si,. . ., Sm) G X3 . 

Proof. Assume the matrix cube problem holds, then 

m 

x^Hqx - Y^ \x'^Hix\ > 
for all X e M". It also implies 

-. rn -. m 

x'^Hox - ^ ^ x'^Q^x ~ - Y,{x^Q,x)-\x'^H,xf > 
where 



i=l 



Q. = 



H,, 



when Hi > 



-H, when H, < 
Apply the Schur complement gives the following polynomial matrix inequality 

2x^HqX — J27Ll X^QiX x'^HiX ■ ■ ■ x'^ H,riX 



L{x) 



X Hix 



•^ ^m-^ 



X^C^lCC 







•^ ^m-^ 



>o. 



It can be verified that L{x) is SOS since 

m rn 

L{x) = ei [ix^ (i/o - Y^ g») x) ef + ^ [ei e,] 
Let C = [1 S^\ ^ and 

5o = i/o + E'^''^^-9E(l-'^')Q 






[ei e,;] " 



?:=i 



5*1 = ^Qj for z = 1, 



. , m 



Thus, 5*0 is an sos polynomial matrix since x^^Sqx = Q'^L{x)C,. This shows that 

(Sq,Si, . . . , Sm ) € <%3 ■ ■ 

The above theorems allow us to limit the search to quadratic certificates in many 
cases. In general, although the refutation with quadratic certificates is not necessary and 
sufficient, it is tight in many cases. Sometimes, we are also interested in which x and 5 
which minimize x'^G{6)x. For example, we would like to know the uncertainty parameter 
and the state which may almost destabilize quadratic stability. To investigate this, we 
examine the dual of © as follows. 



min trace(-ffij) 
such that L = 



L 



Om 



-tVTl 



>0 



_LmO 

Lij = Lji for i, j =: 0, ... ,m 

La = Loo for i = 1, . . . , m 

trace(ioo) = 1 



11 



where 



H 



' Ho 





1 TT 

_2 f^ 
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1 TT 

2 " 









If there exists a rank one optimal solution L* and the optimal value d* is nonnegative, 
this implies G{5) > for all S within the unit cube. To see this, we can decompose the 
rank one solution L* as 



where 6 £ {-1, 1}'", x G 
problem 



L* 



These are then the the optimal solution to the optimization 



mm 

<56{-l,l}" 






x'^iHo 



Thus this can be interpreted as a lifting of the above dual optimization problem to a higher 
dimensional space. This approach gives a lower bound on the matrix cube problem. 

Theorem 16. Suppose L* is the optimal solution of the dual problem and L* is partitioned 
as above. //rank(L*) = rank^L^Q), then G{S) > for all 5 within the unit cube if and 
only if the optimal value d* is nonnegative. 

Proof. We only need to show there is a rank 1 solution of the dual problem. Assume 
L* is an optimal solution of the dual problem and rank(i*) ~ rank{LQQ) . Let p be the 
rank of rank(L*) and rank(LQQ). We decompose L* as follows, 



L* = 



Z 





'Yo' 
Yi 

7™. 




'Yo' 
Yi 

Y,n_ 


T r 



z 



where Z e M"^p, and Fq, ■ • ■ , Y,n G W^p have fuU rank. Since ZYiY^Z"^ = L*^ G §" and 
Yq has full rank, there exists Di G S^ such that Yi = YgDi. For all i,j>l,i^ j, we also 
know 

L*j = ZY,Y[Z^ = ZYoD,D,Y^Z^ 



T nrT 



ZYoDjDiYo' Z 



r* 



and the above condition holds if and only if DiDj = DjDi. It means that {-Di, . . . , D,n} 
is a commuting family and there must exist an unitary matrix U which diagonalized 
Di, . . . , Dm. Let Di = UYiiU^ for i = 1, . . . , to and S^ is diagonal. From L*^ = Lqq, we 
can show 



T ryT 



^ii — ZYiYi Z 
= ZYqD^YJ^Z^ 
= ZYoUY.jU^Y^ Z^ 

— T* 

= ZYoY^Z^ 
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and the above eondition holds if and only if Ef = 1 . Let 
X = ZYqU = [xo xi 



i-pj , 



A 



w. 



for i — 1, 



. . ,m 



where Xi G 
L* as 



and A|, = 1 for i = 1, . . . , m, j = 1, . . . ,p. We can further decompose 



L* 



where ak = WxkW^ and 



X 




X 


T 


Xk 




Xk 


XEi 




XSi 


rn 
k=l 


Xk^lk 




XkMk 


_XT,ni_ 




_XY^m_ 




xXmk _ 




xXrnk _ 



y^afcjfc 



fc=i 



•h 



\Xk\ 



Xk 




Xk 


XkMk 




XkMk 


_x\mk _ 




_x\mk _ 



Substituting L* into the objective function gives 

p 



trace(L*iJ) = ^( trace(JfeiJ) 



fe=i 

Note that each Jk is also a feasible solution of the dual problem and the optimal value 
is the linear combination of several feasible solutions. Hence, every Jk must also be an 
optimal solution and it is rank 1. ■ 

This theorem gives a condition for existence of a rank one solution. In addition, if 
the condition is satisfied, the above construction also gives a procedure to extract the 
uncertainty variable 5 which has the smallest eigenvalue in the matrix cube problem. 

5 Examples 

5.1 Quadratic stability 

In this section, we check quadratic stability of a linear time-invariant system to provide a 
specific numerical example. Suppose the linear time-invariant system with uncertainties 
is 



where ||(5||oo < R- We would like to compute the largest R such that the system is 
quadratically stable for all 5 within the cube. We first study the two-variable system as 
follows. 



■:{t) = 



-0.4 



0.4^2 - 0.8 




-3.2 

0.3(52 - 2.2 



-0.3(5i + 1' 
0.3(5i - 0.5 

5i - 1.7 



,{t). 
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We compute the largest such R for which all 6 within the corresponding cube lead to 
stability. We similarly compute the largest cube admitting quadratic stability, and the 
bounds on this cube obtained using quadratic certificates and Theorem |21 from Ben-Tal 
and Nemirovski. These are shown in Figure [5] As discussed in the previous section, the 
bound obtained using quadratic certificates is exact, and we do not need to pursue higher 
degree certificates. 




- stability 

quadratic stability 
■ quadratic certificates 

Ttieorem 1 



-1 



Figure 2: stability bound from various conditions 



5.1.1 general case 

We also test random cases when m is greater than 2. We let x e K'^, Aq = —4/ and we 
choose m ranging from 3 to 8. For each m, we randomly generate 100 different Ai, . . . , Am 
and compute the actual quadratic stability bound Re, the bound Rg from Positivstellen- 
satz refutation, and the bound Rt using conditions in Theorem|21 After computing these 
three values, we calculate the ratio between Rs, Re and Rt, Re shown in Figure 13 The 
bound using quadratic certificates is very close to the actual quadratic stability bound in 
most of the case, but the stability bound from Ben-Tal and Nemirovski's condition can be 
20 percent smaller than the exact bound. In these examples, the condition in Theorem 
indeed gives a tighter stability bound. 



5.2 MAXCUT problem 

Next, we consider the max cut problem. It is well-known that the max cut problem is 
an NP hard problem and the SDP relaxation provides a tractable approach which has 87 
percents performance guarantee |10l l^. In this example, we convert the max cut problem 
to the matrix cube problem and use the graphs in Figure^ as examples. 

By using Positivstellensatz refutation with quadratic certificates, the optimal capacity 
of the graph in Figure 0] (a) is 9 and the rank of the dual problem is 2. We also can infer 
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^^H Ben-Tal and Nevirovski conditiior 
^^H Psatz with quadratic certiticate 


_ - 1 1 


• 1 1 1 1 



Figure 3: stability bound from various conditions 





(a) (b) 

Figure 4: MAXCUT example 

the solution is exact from Theorem 1161 and the optimal cuts are as follows. 



node 






1 




-1 


2 


-1 




3 




-1 


4 


-1 




5 


-1 




6 




-1 


7 




-1 



We also compute the optimal capacity of the graph in Figure 21(b). The optimal value 
using quadratic certificate is 4 and the rank of the dual optimal solution is 6. Although 
the rank of the dual problem docs not satisfy Theorem ^1 it can be verified that the 
optimal value is exact. Furthermore, there are 6 different choices which can be extracted 
from the dual optimal solution. 
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1 
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-1 


-1 


-1 
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-1 
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-1 
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-1 
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-1 


-1 


1 
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-1 
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-1 


-1 


-1 
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1 
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To compare the numerical result, we list the capacity bound from the SDP relaxation and 
from the Ben-Tal and Nevirovski's condition. The refutation using quadratic certificates 
indeed gives a tight result. 

exact capacity psatz refutation Ben-Tal relaxed SDP 



jraph 1 
graph 2 



9 9.0000 9.925 9.8000 

4 4.0000 4.0625 4.0000 



Although the refutation with quadratic certificates usually gives a tight result, the 
condition is only sufficient in general. To give a counterexample, we consider a fully 
connected graph with 5 nodes. The maximum capacity of this graph is 6 and the capacity 
computed using quadratic certificates is 6.25 which is clearly not tight. 

6 Conclusions 

The question of degree bounds for positivstellensatz refutations is one of significant impor- 
tance for practical use of semidefinite programming for matrix polynomial optimization. 
In this paper, we showed that meaningful bounds can be obtained. We used matrix 
Positivstellensatz refutations to test positive semidefiniteness of an affine function over 
a given uncertainty set. When the uncertainty set is a hypercube, we show that the 
highest degree certificate needed is 2m. Although the certificates are degree bounded, 
computational complexity is still high in general. To reduce the complexity, we study 
the case of quadratic certificates and show that the bounds obtained are still tighter than 
those obtained from existing conditions. We also show several cases when refutation using 
quadratic certificates is exact. This result may be useful in analyzing and synthesizing a 
robust controller for systems with uncertainties and robust quadratic optimization. 
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